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Abstract 

ABSTRACT We introduce the class of piecewise convex transfor- 
mations, and study their complexity. We apply the results to the 
complexity of polygonal billiards on surfaces of constant curvature. 



Introduction 

The following situation frequently occurs in geometric dynamics. There is 
a phase space X, a transformation T : X — ^ X; and there is a finite de- 
composition V : X = X{a) U X{b) U ■ ■ ■ . Let A = {a,b, . . .} be the 
corresponding alphabet. A phase point x G X is regular if every element 
of the orbit x, Tx, T'^x, . . . belongs to a unique atom of V. Suppose that 
X G X{a),Tx G X{b), etc. The corresponding word ah ■ ■ ■ is the code of 
X. Let S(n) be the set of words in A of length n obtained by coding points 
in X. The positive function f{n) = \^{n)\ is the associated complexity. Its 
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behavior as n ^ oo^ is an important characteristic of the dynamical system 
in question. The following examples have motivated our study. 

Example A. Let P C be a polygon with sides a,b, . . . , and let X be 
the phase space of the billiard map Th in P. The coding generated by the 
corresponding decomposition V : X = X{a) U X{b) U ■ ■ ■ is the traditional 
coding of billiard orbits by the sides they hit [12] . Basic questions about its 
complexity are open [Hj. 

Example B. Let P C be a convex polygon with vertices a,b, . . . . The 
complement X = R^ — P is the phase space of the outer billiard To about P. 
(It is also called the dual billiard. See ^Hl)- The conical regions bounded the 
singular lines of Tq form the natural decomposition V : X = X{a)UX{b)U- ■ ■ . 
In X{a), X{b), . . . the mapping To is the symmetry about a,b,.... The 
decomposition V yields the coding of outer billiard orbits by the vertices 
they hit. 

We will study the complexity of (2-dimensional) piecewise convex trans- 
formations. This is a wide class of geometric dynamical systems; it contains 
the examples above. Our setting is as follows. (For simplicity of exposition, 
we restrict our attention to two dimensions.) 

Let X be a geodesic surface, and let F C X be a finite geodesic graph. 
A subset Y G X is convex if for any x,y E Y there is a unique geodesic in 
Y with endpoints x,y E Y. Suppose that the closed faces A(a), X{b), , . . . 
of F are convex, and let V : X = X{a) U X{b) U ■ ■ ■ be the corresponding 
decomposition. We say that "P is a convex partition of X. A differentiable 
mapping T : Y ^ X is convex if it sends geodesies to geodesies. Suppose 
that T : X — * A is a convex diffeomorphism on A (a), X{b), , . . . , and that 
T(A(a)), T(X(6)), also form a convex partition of X. We say that 
the triple (X, T, V) is a piecewise convex transformation with the defining 
partition V. 

Making further assumptions on {X,T,V), we obtain more specialized 
classes of transformations, e.g., piecewise isometries, piecewise affine map- 
pings, etc. The case when the faces of F are convex euclidean polyhedra, and 
T is isometric on them arises in task scheduling problems PP. 

In Section [T] we develop geometric and combinatorial techniques to study 
the complexity of piecewise convex transformations. In the rest of the paper 
we apply these results to the inner and outer polygonal billiards on (simply 

^The function /(•) can be bounded, or grow polynomially, or grow exponentially, etc. 
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connected) surfaces of constant curvature x = 0, 1, —1. One of the goals of 
this work is to develop a uniform approach to these dynamical systems. While 
there is a vast literature on the parabolic case (x = 0), the elliptic {x = 1) 
and the hyperbolic {x = ~1) cases have been studied only sporadically. 

Let M be a surface of constant curvature, and let P C M be a polygon. 
In Section [21 we cast the (inner) billiard map in P as a piecewise convex 
transformation {X, T, V) . See Theorem ^ We do it simultaneously for all 
curvatures, and without making additional assumptions on P. Thus, we 
don't assume that P is convex or simple, and have to pay a price for this. 
The partition V is finer than the "natural" one; the coding it generates is 
more refined than the standard coding by sides ^H] • We develop a dictionary 
between the language of piecewise convex transformations and that of billiard 
orbits. In the remaining part of the paper we come back to Examples A, B 
and study the complexity of natural coding. 

In Section El we investigate the complexity of inner billiard orbits in a 
polygon P on a surface of constant curvature x- section 13.11 P, x are 
arbitrary; later on we specialize to convex P but arbitrary x, to x = 0, and 
to X = =tl respectively. Below we formulate the main results. 

The side complexity of billiard orbits in any rational euclidean polygon grows 
at most cubically; see Theorem El 

The side complexity of billiard orbits in any spherical polygon grows subex- 
ponentially; see Theorem El 

The side complexity of billiard orbits in any hyperbolic (i.e., x = —1) polygon 
grows exponentially; the exponent in question is the topological entropy of 
the billiard map; see Theorem El 

Section HI is the outer billiard counterpart of Section El Here are some of 
its results. 

For X = ciiid arbitrary polygon (resp. rational polygon) we obtain poly- 
nomial bounds from above and below (resp. quadratic asymptotics) for the 
complexity; see Theorem El and Theorem [71 respectively. 
For X = 1 complexity grows subexponentially; see Theorem El 
For X = "~1 and arbitrary polygon, we obtain linear lower bound for com- 
plexity, which is sharp: for the so-called large polygons complexity grows 
linearly; see Theorem El 

Notes and references. We are grateful to the Research in Pairs program 
in Oberwolfach and to the Shapiro visiting program at Penn State for their 
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support. The second author was partially supported by an NSF grant. The 
work |U 12] is the predecessor of our Section 3.^ For additional results on 
polygonal billiards see [H d [HI 120] • 

1 Piecewise convex transformations 

1.1 Convex geodesic surfaces 

We will introduce a class of maps of geodesic spaces. In order to simplify our 
exposition, we will restrict it to two dimensions, i.e., to geodesic surfaces. 
Let M be one. Then M is a topological surface. It may have a boundary, 
dM, and a finite number of cone points. The surface M is endowed with a 
collection of geodesies, satisfying the standard properties. In particular, dM 
is a finite union of geodesies. Let x,y & M he any pair of points. Then M 
is geodesically convex if there is a unique shortest geodesic 7 = 7(x, y) G M 
joining them.'^ 

Examples, i) The set endowed with a projectively flat (e.g., Minkowski) 
metric is a geodesic surface. Its geodesies are straight lines. Let M C 
be a closed, bounded convex region. Then it is a geodesic surface iff M is a 
polygon. The geodesic 7(0;, y) is the segment with endpoints x, y. 
ii) Let be the round sphere, and let M C be a convex spherical polygon. 
Then M is a geodesic surface iff it does not contain antipodal points. This 
holds iff M is contained in an open hemisphere. 

In what follows we will often say "convex geodesic surface" instead of 
"geodesically convex geodesic surface". Let X be a geodesic surface. A finite 
graph r drawn on X is a geodesic graph if the edges of F are geodesies. We 
will assume that the cone points of X are contained in the set of vertices of 
F, and that the latter are nondegenerate. (A vertex is degenerate if it has 
two adjacent edges, and they are colinear.) 

Let X{a),X{b), ... be the (open) faces of F, and let Pa, Pb, ■ ■ ■ C X he 
their closures. We will say that F is a convex geodesic graph if the surfaces 
Pa, Pb, - ■ ■ C X are geodesically convex. We will refer to the data {X, F) 
as a piecewise (geodesically) convex geodesic surface. We will also say that 

■^See especially Remark 7 in [5]- 

■^Although the uniqueness condition may seem too restrictive, it is crucial for our study 
of iterations of piecewise convex transformations. See section Fl .41 below. 
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V : X = PaU Pb, ■ ■ ■ is a convex geodesic partition of the geodesic surface 
X. The boundary dV C X is spanned by the edges and vertices of F. 
We will also refer to it as the support of F and denote by < F > . There is a 
1 — 1 correspondence between convex geodesic graphs drawn on X and convex 
geodesic partitions of X. The latter concept provides an alternative approach 
to the material below ^U] . However, the language of convex geodesic graphs 
is more suitable for our purposes, and we will use it in what follows. 

Let X be a convex geodesic surface, and let Y be an arbitrary geodesic 
surface. A diffeomorphism (not necessarily surjective) T : X — >■ F is a 
geodesically convex transformation if it sends geodesies to geodesies. Then 
T{X) = Z G Y is a. convex geodesic surface as well, and the inverse map 
: Z X is a. geodesically convex transformation. 

1.2 Piecewise convex transformations: iterations, cod- 
ing, and complexity 

We will now introduce a class of dynamical systems which, on one hand, is 
sufficiently general to include several interesting examples, and on the other, 
is special enough to allow a common geometric framework. Let X, F, P = 
V(T) be as above. Let p be the number of atoms of V and write V : X = 
U^^^Pj. Suppose that for 1 < i < p there is a convex transformation Tj : 
Pi — > X. Set Qi = Ti{Pi). Suppose that X = U'-^iQi and that the open 
sets int{Qi) are pairwise disjoint. Then Q : X = U^^^Qi is a convex geodesic 
partition, and dQ is the support of a convex geodesic graph, F~^, drawn on 
X. 

These data determine a piecewise convex transformation T : X X with 
the defining partition V, and we will use the notation {X,T, V) for it. The 
inverse of {X, T, V) is also a piecewise convex transformation. Its defining 
partition is Q = T(V). Thus in our notation, {X,T, V)~^ = (X, T~^, Q). 

Invertible piecewise isometric (as well as affine, or projective) maps are 
examples of piecewise convex transformations. Let M be a simply connected 
surface of constant curvature, and let P C M be a geodesic polygon. In 
Sections El and |3] we will put the inner and the outer billiard about P into 
the framework of piecewise convex transformations. 

Denote by C the full shift space on the alphabet A = {a, b,c, . . .} of the 
faces of F. A point x E X is regular if x, Tx, T'^x, . . . , belong to open faces 
of F. Let Xoo C X be the set of regular points. Assigning to x G Xqo the 
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sequence of faces of F containing the consecutive elements x, Tx, T^x, . . . , we 
obtain the coding map a : X^o — > C Set S = (t(Xoo), and let be the 
set of words of length n that occur in S. The function f{n) = \^{n)\ is the 
complexity of {X, T, V) with respect to the defining partition. 

Let r', r" be two geodesic graphs on X. Their join V V T" is the (unique) 
geodesic graph such that < r'VT" > = < T' > U < T" > . We write T" -< T' 
if r' V r" = r". Recall that V V V" denotes the join of partitions, and that 
V" -< V holds if V V V" = V". Let V = V{T'),V" = V{T"). If L', L" are 
convex geodesic graphs, then so is r'VF", and ^(r' VF") = 'P(F') V ^(F"). 
Moreover, F" -< T' iff V" -< V. 

Set Fi = F, F2 = Fi V r-i(F), . . . , F„+i = F„ V T-"(F), .... The convex 
geodesic graphs F^, k = 1,2, .. . form an increasing tower with respect to 
the relation -<, and we set 5*^ =< F^ >, Vk = V(Tk). The singular set 
Soo = U^j^S'fc = \ -^00 is a countable (at most) union of geodesies. Note 
that {X,T"-, Vn) is a piecewise convex transformation for n>l. 

Let X = Xi,Tx = X2, . . . , T"-~^x = x.„ be a finite orbit such that the points 
Xi,X2, ■ . ■ ,Xn belong to open faces of F. We say that xi, 0:2, . . . , a;„ is a regular 
orbit of length n and denote by o"(xi, X2, . . . , a:„) the corresponding word on 
the alphabet A] it is the code of xi,X2, ■■■ ,Xn- Then S(n) is the set of codes 
of regular orbits of length n; the orbit x = Xi,Tx = X2, ■ ■ ■ ,T"-~^x = Xn is 
regular iff x belongs to an open face of the graph F„. 

The proposition below summarizes the discussion. 

Proposition 1 Let {X, T, V) be a piecewise convex transformation, and let 
< r >= dV. Then: 

1. There is a sequence T^^ k > 1 of convex geodesic graphs in X such that 

■ ■ ■ ^ F„+i ^ F„ ^ ■ ■ ■ ^ Fi = F; 

2. Set Vn = ViTn), n > 1. Then Vn is a convex geodesic partition, and 
the nth iteration of (X, T, V) is a piecewise convex transformation with the 
defining partition Vn, i- e., (X, T, P)" = (X, T", Vn)- 

3. There is a natural bijection between the set E(n) and the set of atoms 
of the partition Vn- Thus, the complexity f{n) is the number of faces of the 
graph F„. 

1.3 A combinatorial lemma 

We will need a general proposition that concerns the combinatorics of graphs. 
Let X be a piecewise geodesic surface. Let F', F" be geodesic graphs drawn 
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on X and set F = F' V F". (We do not assume that the faces of F', F" are 
convex.) 

Denote by F', F", E" , V, V" the respective sets of faces, edges and 
vertices. Let E, F, V be the sets of faces, edges and vertices of F. If e' e 
E', e" G E" intersect non-transversally, then they (partially) overlap. There 
are 4 ways in which this can happen. See figure ^ Denote by c(F', F") the 
number of the overlapping pairs of edges. 




Figure 1: Overlapping of edges of two graphs 



Lemma 1 Let F', F" be geodesic graphs drawn on a piecewise geodesic sur- 
face X. Denote by x the Euler characteristic of X . Let V^,V^' be the 
sets of vertices of F', F" that are disjoint from the other graph, and set 
Vess = V-V^-V^'. Then 

\F\ - \F'\ - \F"\ +x= \Vess\ - c{r', T"). (1) 

Proof. Any graph A drawn on X satisfies 

\F{A)\-\E{A)\ + \V{A)\=x{X). (2) 

Applying Q to graphs F', F", F, we obtain for the left hand side of 

|F| - - + X = {\E\ - \E'\ - \E"\) + {\V'\ + \V"\ - \V\). (3) 

Denote by e[, e'j the edges of F', F" respectively. Let a^, a" be the number 
of vertices of F",F' that are located in the interior of e-,ej respectively. 
Let b^,bj be the number of times that the interior of e-,ej transversally 
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intersects the interior of an edge of T", T' respectively. Then e[, e'- contribute 
a[ + h[ + l,a'- + b'j + 1 edges to E respectively. Taking the overlapping into 
account, we obtain 

1^1 = E < + E + l^'l + E + E + - ^(r', r"). (4) 

i i 3 3 

Let Vc be the set of common vertices of F', V" . Let V^, V'^ be the sets of 
vertices of F', F" that are in the interior of edges of the other graph. Then 

i^i = iKi + i^ii + iKi, i^"i = ik"i + ik;i + iki. (5) 

Besides 

E<=l^e1, E<=l^e|- (6) 

* 3 

Let V^ = V\{y' \^ V") be the set of "new" vertices of F. Then 

E^:=E^;'=i^^i- (7) 

« 3 

We also have 

1^1 = IK'I + IK"I + \n + + 1^1 + (8) 

From equations (jH) , © , and ((Zj), we obtain 

\E\ - \E'\ - \E"\ = \V^\ + \V"\ +2\Vn\- c(F', F"). (9) 
By equation (jH)), 

\V'\ + \V"\ - \V\ = \Vc\ - \Vn\. (10) 
Substituting (Pl- ffTUj) into Q, and using (jH)) again, we obtain the claim. ■ 

The expression for |-F(F' V F")| — |F(F')| — |F(F")| in Lemma ^ involves 
information about vertices of F', F" which is sometimes not available. The 
following corollary of Lemma ^ is useful. 

Proposition 2 Let F', F" be geodesic graphs drawn on a piecewise geodesic 
surface X of Euler characteristic x- Let F = F' V F", and let the notation he 
as above. Then 

\Vn\ < \F\ - \F'\ - \F"\ +X + c(F', F") < \V\. (11) 
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Proof. By Lemmas and equation (jSJ, the quantity to estimate in (lllj) is 
equalto |V;'| + |K"| + |K| + |V;|. ■ 

The following special cases of Lemma d and Proposition El will be espe- 
cially useful. 

Corollary 1 Let X he a geodesic surface homeomorphic to the open disc. 
Let r', r" be geodesic graphs drawn on X such that their edges intersect only 
transversally. Let T = T' V T" and let the sets F, F', F", V, K, V^, V^', Vess be 
as above. Then 

\F\ - \F'\ - \F"\ + 1 = \Vess\ (12) 

( see figure and 

\Vn\ < \F\ - \F'\ - \F"\ + 1 < \V\. (13) 

IfV^ = V'l = then 

|F| - - + 1 = I'^'l- (14) 

Proof. By our assumptions, c(r', F") = and X = 1- Hence Lemma ^ and 
Proposition H yield ^ and ^ respectively. If = V'l = then V = Vess 
and jni) becomes (HD). ■ 



1.4 Geometric formula for complexity of piecewise con- 
vex transformations 

Let S be a language on a finite alphabet A, and let T,{n) be the set of words 
of length n in S. The complexity of S is the function f{n) = |S(n)|. Set 
(p{n) = f{n + 1) — f{n) and ip{n) = Lp{n + 1) — i^in). We will refer to the 
functions (/?(■),■?/;(■) as the first, second differences of complexity, respectively. 

Our approach is based on Cassaigne's formula for ■?/'(■) Denote by 
mi{w),mr{w) the number of left, right one-letter extensions of the word w 
respectively. We will assume, following that mi{w),mr{w) > 1 for any 
w G S. A word is bispecial if mi{w) , mr{w) > 1. Let mh{w) be the number of 
extensions of the type awb where a,b E A. Let i3 C S be the set of bispecial 
words, and set B{n) = 3(1 T,{n). The Cassaigne index is defined by 

fi{w) = mb{w) — mi{w) — mr{w) + 1. (15) 
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Figure 2: Illustrating formula dH)): |F| = 12, = 4, = 5, \Vess\ = 4 



Note that if w is not bispecial then fi{w) = 0. The Cassaigne formula says 

We define the cumulative index by ^{n) = J2we^{n) f^i"^) ^'^^ n > 1, and 
/i(0) = 0. Set 

Min) = Y,m- (17) 

k<n 

Lemma 2 T/z-e complexity of a piecewise convex transformation satisfies 

fin) = /(I) + {n- l)(/(2) - /(I)) + 5^ M{k). (18) 

fc<n-2 

Proof. Denote by g{n) the right hand side of p8|). Since, by (jl6ll7p . the 
second differences of f{-),g{-) are equal, /(n) — g{n) is linear in n. But 
/(l)-(7(l) = /(2)-(?(2) = 0. 

Let (X, T, V) be a piecewise convex transformation, and let S be its 
coding language. For w G let X(u') C X be the corresponding open 

face of the graph F^. We denote by T{w) the restriction of F_i V F„+i to 
X{w). Let Vess(w^) (resp. OE{w)) be the set of essential vertices (resp. pairs 
of overlappings edges) for F(tf;). 
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Lemma 3 For any w G Ti we have 

^i{w) = \Vess{w)\-\OE{w)\. (19) 

Proof. Denote by F', F" the restrictions of F„+i,F_i to X{w) respectively. 
Then in the notation of Lemma ^ mb(w) = \F\,mr{w) = \F'\,mi{w) = \F"\. 
Since X{w) is contractible, x = 1 in equation (jT)). Thus, the left hand side 
of equation (jT)) is fi{w). But its right hand side is |Vess('W^)| ~ \OE{w)\. m 

We will use the notation c{w) = \OE{w)\. For n > 1 set 
Vess(n) = U^e^in)Vess{w), v{n) = l^essWI, V{n) = 5^t;(/c), (20) 

k<.n 

and 

OE{n) = U^eE(n)OE(w), c{n) = \OE{n)\, C{n) = 5^c(A;). (21) 

k<n 

Thus, v{n) (resp. c(n)) is the number of "new" essential vertices (resp. "new" 
edge overlappings) of the graph F_i V F„+i, while V{n) (resp. C(n)) is the 
total number of essential vertices (resp. edge overlappings) of F_i V F„_|_i. 
Note that only bispecial words contribute to these numbers. 

Proposition 3 Let [X, T, V) he a piecewise convex transformation and let 
Vi = V, V2, ■ ■ ■ be the corresponding sequence of convex partitions. Then the 
complexity of (X, T, V) satisfies 

fin) = \V,\ + in- l)i\V2\ - \V,\) + V{k) - C{k). (22) 

k<n-2 k<n-2 

Proof. We have /(I) = |Pi|, /(2) = \'P2\- By LemmaEl /u(n) = v{n) — c{n), 
hence M{n) = V{n) — C{n). The claim now follows from equation (jl8p . ■ 



2 Billiard map as a piecewise convex trans- 
formation: the dictionary 

Let M be a complete simply connected surface of constant curvature,^ and 
let P C M be a geodesic polygon. In order to cast the billiard map in P as a 

''^We normalize the curvature to or —1 or 1. Thus M is either the euchdean plane or 
the hyperbolic plane or the unit sphere. We will refer to these geometries as parabolic, 
hyperbolic and elliptic respectively. 
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piecewise convex transformation simultaneously for all three cases at hand, 
we will use the models of the hyperbolic and elliptic geometries where the 
geodesies are straight lines in the euclidean plane. (We will refer to them as 
the projective models.) 

For X = — 1, this is the Klein-Beltrami model of hyperbolic geometry. 
The hyperbolic plane is represented by the open unit disc, the unit circle S 
is the "circle at infinity" , and geodesies are the chords of this disc. Let x, y 
be distinct points in the disc, and let a, h be the intersection points of the 
line xy with S. We identify the oriented line xy with R, and hence x, y, a, h 
with real numbers. The cross-ratio of the four points is given by 

{y-a){h-x) 

a. 2;, y, b\ = — -. 

{x-a){b-y) 

The distance between points satisfies 2d{x,y) = ln[a, x,y,b]. In this model, 
isometries of the hyperbolic geometry are the projective transformations of 
the euclidean plane, preserving the unit disc. 

Projective model of the elliptic geometry (i.e., x = +1) is as follows. We 
restrict our attention to an open hemisphere; consider for concreteness the 
northern hemisphere. Its central projection to the tangent plane at (0, 0, 1) 
is a surjective diffeomorphism that takes spherical geodesies to euclidean 
straight lines. 

In order to endow the billiard map phase space X = X{P) with the 
structure of a geodesic surface in a uniform fashion, we will impose a slight 
restriction on P. Let P C M be a geodesic polygon, and let a be a side of P. 
We denote by Sa the geodesic reflection in M about a, and set Pa = PUSa(P). 

Definition 1 Let P G M be a spherical polygon. Then P is admissible if 

for any side a the polygon P^ is contained in an open hemisphere. 

Note that the admissibility is a restriction only in the elliptic case.^ Unless 
we state otherwise, we will consider only admissible polygons, suppressing 
the qualifier. 

The space X = X{P) consists of directed geodesic segments inside P 
both of whose endpoints belong to dP. Since we are using projective models, 
P C is a euclidean polygon in any of the three cases at hand. Geodesic 
segments in P are straight; we refer to their endpoints as the beginning 

^We think that aU of our results remain vahd without this restriction. 
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b{x) and the end e{x). The mapping x i— (&(x),e(x)) is an embedding 
X C dP X dP; it induces a topology on X. 

Let L be the space of oriented straight hnes (rays) in the euchdean plane. 
Endowed with the natural topology, it is a cylinder. Besides, L is a geodesic 
surface: geodesies in L are the pencils of rays passing through a point or 
the pencils of parallel rays. Equivalently, we define this structure via the 
canonical embedding C RP^. Lines in R^ become points of the dual 
projective plane (RP^)* ~ RP^. The geodesic surface structure of L is thus 
induced by that of the real projective plane. 

Denote by l{x) G L the ray containing the chord x. The mapping X — L 
given by X 1-^ l{x) is finite-to-one; if P is convex then it is one-to-one. It 
induces the structure of a geodesic surface on X. 

Let A+ C X (resp. A_ C X) be given by the condition that e{x) (resp. 
b{x)) is a corner of P. Let Aq C X be the set of chords that contain a corner 
of P in the interior. Set 

A = A+ U A_ U Aq. 

By definition, A is a geodesic graph in X. The following lemma is crucial. 

Lemma 4 The faces of the graph A are geodesically convex. 

Proof. Let Xq = AoBo,xi = AiBi e X \ A, and let Xt = AtBt, t e [0, 1], 
be a path in X \ A connecting them. Then the points At, t G [0, 1] (resp. 
Bt, t & [0, 1]) belong to the interior of a side, a C dP (resp. h C dP). 

Up to relabeling and orientation reversal, the points in question may form 
four apriori possible configurations; the four cases are shown in figure El 

Cases 3,4 contradict to our assumptions. Indeed, in case 4 the sides a, 6 
intersect at their interior points. In case 3 let Vq, Vi be the endpoints of the 
side h. The two frames AqBq, VqVi and Ai-Bi, VqVi have opposite orientations, 
thus for some < t < 1 the vectors AtBt, VqVi are colinear, in contradiction 
to the assumption that AtBt G X \ A. 

In cases 1,2 let O G R^ be the intersection point of the straight lines 
AqBq, AiBi.^ Let 7 be the curve in X obtained by rotating the oriented line 
AqBq about O towards AiBi by an angle less than vr. It is a geodesic. To 
show that 7 does not intersect A, it suffices to prove that the quadrilateral 
AqAiBiBq contains no vertices of P. Assume that it does, and let V be such 

^In case 1 the two lines may be parallel, but the same argument works. 
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a vertex. The frames AqV, AqBq and AiV, AiBi have opposite orientations. 
Hence, for some < r < 1 the vectors A^-V, A^-Bj. are cohnear, and thus the 
segment Xr = A^Br contains a corner of P, in contradiction to the assump- 
tions. ■ 



We denote hy : X X the bilhard map and by : X — X its 
inverse. They are not defined on all of X, and there are choices in defining 
them on A. To avoid the ambiguities, we will now precisely define Ti,,T^^ 
on their respective domains of definition. 

Let X = [b{x),e{x)] be a phase point. Then xi = Tb{x) (resp. x_i = 
Tf^^(x)) is not defined iff e{x) (resp. b(x)) is a corner of P. Thus, the 
natural domain of definition for Tf, (resp. T^~^) is X \ A_|_ (resp. X \ A_). 
Suppose now that e(x) is not a corner, and let a be the unique side of P that 
contains e{x). Let li{x) be the reflection of l{x) about a. Let Xi = Tb{x) = 
[e(x),e(xi)] C h{x) be the longest chord such that [e{x),e{xi)] G X. This 
defines T;, on X \ A+. The definition of T^~^ on X \ A_ is analogous, and we 
leave it to the reader. Set 

r = A U T,-\A \ A_), e = (A \ A_) U T,-\Ao). (23) 

Proposition 4 The following holds: 

1. The subset Q G X is the set of discontinuities of the billiard map. 

2. The faces of T are geodesically convex. 

Proof. It is elementary to see that A+ belongs to the set of discontinuities. 
(The billiard map is not even defined on A4..) Let x G Aq. Then arbitrarily 
close to X there are phase points x', x" such that e(x'), e{x") belong to distinct, 
and non-adjacent, sides of P. Hence b{T}y{x')) and b{Th{x")) are not close to 
each other, and Tf, is discontinuous at x. Let x ^ A+. Then xi = Ti,{x) 
is defined. If however xi G Aq, then arguing as above, we conclude that 
e(Tft(x')) and e(Tb{x")) are not close to each other, and Tf, is discontinuous 
at X. See Figure El On the other hand, if Xi ^ Aq, then x is a point of 
continuity of T^. This proves the first claim. 

Let x' , x" belong to a face of F. Arguing as in the proof of Lemma |3J we 
see that e{x'),e{x") belong to the same side, a, of P. Set Q = Pa, and let 
Y = X{Q). The "reflection" trick associates with any phase point x G X 
such that e(x) G a a phase point y eY The correspondence x ^ y maps 
a curve x(t), < t < 1, connecting x',x" in X into a curve y(t), < t < 1, 
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connecting y', y" in Y . Let A(Q) C F be the corresponding set of phase 
points containing corners. The condition x{t) GX\r, 0<t<l, imphes 
that y{t) \ A{Q), < t < 1. By Lemma |3J phase points y',y" are con- 
nected by a geodesic, /3, in F \ A{Q). Folding /5 back into X by the geodesic 
reflection Sa, we obtain the geodesic a connecting x',x" in X \ F. This es- 
tablishes the second claim. ■ 




We will now cast the billiard mapping as a piecewise convex transforma- 
tion. 

Theorem 1 Let M be a simply connected surface of constant curvature, and 
let P C M be a geodesic polygon. Let X = X{P) be the phase space of the 
billiard map endowed with the structure of a geodesic surface. LetTb : X ^ X 
be the billiard map. 

Let F be the graph defined by \2'Jji . and letV : X = X^ U U ■ ■ ■ be the 
corresponding convex geodesic partition. 

Then T is a convex geodesic graph, and Tb is continuous on the faces 
of F. Let T be the map that coincides with Tb on the open faces of F and 
extends to their closures by continuity. Then {X, T, V) is a piecewise convex 
transformation; the billiard map Tb and the transformation (X, T, V) coincide 
onX\V. 
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Proof. Most of the statements have been estabhshed in the course of the 
preceding discussion. For instance, Proposition E] asserts that F is a convex 
geodesic graph. It remains to show that the restriction of to any open 
face of F is a geodesically convex transformation. 

The geodesic structure on X has been defined via ray focusing.^ Geodesic 
refiections send focusing beams into focusing beams. Let F C X be a face 
of F. As we have seen in the proof of Proposition EJ the endpoints h{x) of all 
phase points x G F belong to the same side, a, of P. Hence, for all x G F the 
new phase point xi = Tb{x) is obtained via the geodesic refiection Sa- Hence 
Tb sends geodesic segments of Y into geodesic segments. ■ 

It has been traditional to study the complexity of billiard orbits in a poly- 
gon P using the coding by sides of P [12]. Let (X, T, V) be as in Theorem [T] 
The complexity of billiard orbits with respect to the coding by atoms of V 
coincides with the complexity of {X, T, V). We will study it, and then apply 
our results to the traditional billiard complexity. 

First, we will establish a dictionary between the language of billiard orbits 
jni El i^aX of piecewise convex transformations. A billiard orbit of 

(combinatorial) length n is a sequence 7 = xi, . . . , a;„ of phase points such 
that Xj+i = Tb{xi). Geometrically, 7 is a sequence of n consecutive chords 
of P, where each chord is the refiection of the preceding one. In particular, 
the points e(xi), . . . ,e(x„_i) are not corners. We will also say that 7 is a 
n-segment orbit. If e{xn) is not a corner, then the 1-step forward extention 
is Xi, . . . ,Xn, Xn+i, where Xn+i = Tb{xn)- If b{xi) is not a corner, then the 
1-step backward extention is . . . ,Xn, where X-i = Tj^^(xi). We can 

iterate these extentions in obvious ways. 

A billiard orbit is regular if it does not contain corners. Otherwise, 7 is 
singular. If 7 does not contain corners of P in its interior, but the endpoints 
6(7) = b{xi),e{'y) = e{x„) are corners, we say, following [12], that 7 is a 
generalized diagonal of length n. 

The notion of generalized diagonals works well for the billiard in a convex 
polygon. We introduce an extension of this notion which works for arbitrary 
polygons. 



^We use the self-explanatory language of geometric optics in discussing billiard dynam- 
ics [ini. 
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Definition 2 An n-segment billiard orbit 7 = xi, . . . , is strongly singular 
if X2, ■ ■ ■ ,Xn-i do not contain corners but Xi and x„ do. 

A family of billiard or&zts is a one-parameter family 7 (t) = Xi{t), . . . ,Xn{t) 
where the mapping t h-* 7(t) is injective and continuously differentiable. In 
particular, we will consider families of strongly singular billiard orbits. Any 
such is contained in a unique maximal family, and we will consider only 
them, suppressing the qualifier maximal. A strongly singular billiard orbit is 
isolated if it is not contained in a family of such orbits. 

Proposition 5 Let P G M be a geodesic polygon, and let {X, T, V) be the 
corresponding piecewise convex transformation. Let n > 1. Then: 

1. There is a bisection between the set Vess{f^) o.iT'd the union of the sets of 
isolated {n + 2) -segment and {n + 3) -segment strongly singular billiard orbits; 

2. There is a bisection between the set OE{n) and the union of the sets of 
families of [n + 2) -segment and (n + 3) -segment strongly singular billiard 
orbits. 

Proof. Let x E X \ r„. Iterating the billiard map, we obtain an [n + 1)- 
segment billiard orbit x = xi, - ■ ■ , x„, Xn+i, where x„+i = T^{x). Let Xn+2 = 
Th{xn+i). Then x G r„_|_i iff either Xn+i G Aq U or Xn+i E X \ A but 

Tb{Xn+l) = Xn+2 G A. 

Set x_i = Tfl'^^x). Then x G r_i iff x_i G A \ A_|_. Thus, we have 
obtained a surjective map from < r_i V {Tn+i \ r„) >C X to the union of 
set of (n + 2)-segment and (n + 3)-segment strongly singular billiard orbits. 
(The orbit corresponding to the former case, and 

xi, ■■■ ,Xn, Xn+i,Xn+2 in the latter.) 

The map above is a bijection. Moreover, isolated orbits correspond to 
the essential vertices of r_i V (r„+i \ r„), and families of orbits correspond 
to overlapping edges of F^i and Tn+i \ r„. ■ 



3 Complexity of the billiard in a polygon 

We will now apply the preceding material to the complexity of billiards in 
geodesic polygons on surfaces of constant curvature. In the beginning of this 
section we consider the three cases at hand simultaneously, emphasizing their 
similarities. 
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3.1 Arbitrary curvature, any polygon 

Let M be a surface of constant curvature x = 0, ±1, and let P C M be a 
geodesic polygon. The operation of unfolding sends billiard orbits in P into 
geodesies in M [12], see figure El If 7 = xi,X2, ■ ■ ■ ,Xn is a billiard orbit, 
then its unfolding is the geodesic 7 = Xi, X2, . . . , 5n where the segments Xj, Xi 
differ by an isometry of M. 



P 





\ 7 

























Figure 5: Unfolding a billiard trajectory 

Let G{P) C Iso{M) be the group generated by the geodesic reflections 
in the sides of P. Denote by G^'^\P) C G{P) the set of elements obtained 
from products of at most n reflections. (These are the elements of length 
at most n.) Then G^'^-'(P), < n < 00, is an increasing tower of finite sets; 
their union is G{P). 

Lemma 5 1. Let x ^ 0- Then all strongly singular billiard orbits in P are 
isolated. 

2. Let X > 0. Let 7 = Xi,X2,...,x„ be a strongly singular billiard orbit 
in P and let 7 = Xi,X2, • • • be its unfolding. Suppose that 7 extends to 
a family of strongly singular billiard orbits. Then there are corner points 
Pi e Xi,Pn € Xn and an isometry g of M such that g{xn) = Xn and the points 
Pi,g{Pn) either coincide or are antipodal. 

Proof. Let 7(t) = xi(t) , X2{t) , . . . , Xn(t) , < t < 1, be a family of strongly 
singular billiard orbits. The segments xi{t) (resp. Xn{t)) pass through the 
same corner point pi (resp. We view 7(t) as a beam of trajectories that 
emanate from the focusing point pi and refocus at pn- 

The unfolding 7 t— > 7 transforms directed billiard orbits into directed 
geodesies in M, preserving the length and sending focusing beams of billiard 
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orbits into focusing beams of geodesics|16j.^ The beam 7(t) emanates from 
Pi G M and refocuses at g{pn) £ M where g G G{P). The distance between 
PiyOiPn) along any geodesic ^{t) is the same as the distance between pi,Pn 
along the orbit 7(t), hence positive. 

If X < 0, this implies pi ^ g{Pn)', thus the geodesic beam 'j(t) has two 
different focusing points. This is impossible, which proves the first claim. 
If X > 0, i.e., M is the sphere, the focusing points in question are either 
antipodal or they coincide. ■ 

We denote by s{k) (resp. fs{k)) the number of isolated (resp. families 
of) strongly singular fc-segment billiard orbits in P. Set 

S{n) = ^ s{k), FS{n) = ^ sf{k). (24) 

3<A:<n 3<fc<n. 

Proposition 6 Let P be a geodesic polygon on a surface M of constant 
curvature x- Let {X,T,V) be the associated piecewise convex transformation, 
and let /(■) be the billiard complexity corresponding to the partition V. Then 
there are positive integers qi,q2 depending on P, so that: 

1- Ifx = 1; then 

f{n) = qi+q2n+Sin+l)-FS{n+l)+2 I ^ 5(A;) - ^ FS{k)] . (25) 

\3<A:<n 3<fc<n / 

2- Ifx< 0, then 

f{n) = qi + q2n + S{n + l) + 2 ^ S{k). (26) 

3<fc<n 

Proof. We use Proposition El to express the right hand side of (j22j) via the 
numbers of (families of) strongly singular billiard orbits. This yields the first 
claim. Taking into account Lemma we obtain the second claim. The factor 
of 2 in ()25l is due to the fact that the contribution of /c-segment strongly 
singular orbits with k < n is counted twice. See Proposition El ■ 



Although assumes that x = 0, the argument apphes to arbitrary x- 
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There is a correspondence between strongly singular billiard orbits and 
generalized diagonals. Let 7 = Xi, X2, . . . , x„, n > 3, be a strongly 
singular orbit. Let p E Xi (resp. q G x„,) be the last (resp. the first) corner 
point. Note that p 7^ e(xi),g 7^ b{xn)- Set xi = [p,e{xi)],Xn = [b{xn),q]- 
Then 7 = xi, X2, . . . , x„ is a generalized diagonal. The mapping 7 h-s- 7 
is a bijection, and it preserves the combinatorial length.^ 

Let gd{n) (resp. fgd{n)) be the number of ra-segment isolated (resp. 
families of) generalized diagonals, n > 3. Set 

GD{n) = J2 9d{k), FGD{n) = J] fgd{k). (27) 

ii<k<.n 3<k<n 

Theorem 2 Let P be a geodesic polygon on a surface M of constant non- 
positive curvature. Let {X, T, V) be the associated piecewise convex transfor- 
mation, and let f{-) be the billiard complexity corresponding to the partition 
V. Then there are integers Ci,C2 depending on P, so that: 

f(n) =Ci + C2n + GD{n + l) + 2 ^ GD{k). (28) 

3<fc<n 

Proof. By Lemma strongly singular billiard orbits are isolated. The same 
argument shows that generalized diagonals are isolated, as well. The claim 
now follows from and the correspondence between strongly singular bil- 
liard orbits and generalized diagonals. ■ 

We will now apply the preceding material to the complexity, F{-), of the 
coding billiard orbits by the sides of P. To avoid ambiguities, we will define 
this coding now. Let P have p sides a,b, . . . , and denote by X{a, b) G X the 
set of phase points x such that b{x) G a, e(x) G 6. As a 7^ 6 run through 
the pairs of sides such that X{a, b) has a nonempty interior, the sets X{a, b) 
form the partition V^^^^ of the phase space. Then the side complexity., F{-), 
is the complexity of the billiard map with respect to "Pgi^jg- 

It will be useful to have a direct definition of the side complexity. We 
denote by >Cgj^g the full language on the alphabet of sides of P. Let now 7 = 
Xi^j . . . , Xfi be a re gular n-segment billiard orbit. Then 6(xi), . . . , &(x„), e(x„) 
are interior points of sides Si, . . . , s„, Sn+i, and we set 

'^side(^) = -51, • • • , Sn, Sn+i G >Cgj^g(ra + 1). 
^However, it does not preserve the property to be isolated. 
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The language Sgj^g is the range of the mapping, and we set Sg-^g(n) = 
^side ^side'^'^)' Then the side complexity satisfies 

FH = |SgidJn + l)|. (29) 
To compare complexities, we will use an elementary lemma. 

Lemma 6 Let {X,T,V) be a piecewise convex transformation, and let /(■) 
be the corresponding complexity. LetVi be a partition, such thatV -< Vi, and 
let /i (■) be the complexity of (X, T, V) with respect to Vi . Then fi (n) < f{n) . 

Corollary 2 Let P be a geodesic polygon on a surface M of constant cur- 
vature X, o,nd let F{-) be the complexity of coding billiard orbits by the sides 
of P. Then the following inequalities hold: 
1. Ifx = ^, then there are constants qi,q2 such that 

F{n) <qi+q2n+S{n+l)-FSin+l)+2l ^ S(A;) - ^ FS{k)] . (30) 

\3<fc<n 3<fc<n / 

2- If X ^ 0; then there are constants ci,C2 such that 

F{n) < ci + C2n + GD{n + 1) + 2 ^ GD{k). (31) 

3<fc<n 

Proof. Let V be the defining partition of the associated piecewise convex 
transformation. By Proposition |1[ the partitions ^gj^ie satisfy V -< V^^^^^^. 
Now the first (resp. second) claim is immediate from Proposition El (resp. 
Theorem 121) and Lemma IHl ■ 



3.2 Arbitrary curvature, convex polygon 

The preceding considerations drastically simplify for convex polygonal bil- 
liard tables. 

Proposition 7 Let P G M be a convex geodesic polygon on a surface of 
constant curvature x- Let F{-) be the traditional complexity of billiard orbits 
in P coming from the coding of billiard orbits in P by the sides they hit. 
Then there exist constants Ci, C2 depending only on P such that the following 
holds: 
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1. Let X = 1- Then 

F{n) = ci + C2n+ ^ GD{k) - ^ FGD{k); (32) 

3<fc<n 3<fe<n 

2. Letx<0. Then 

F(n) = ci + C2n+ J] GD{k). (33) 

3<fc<n 

Proof. In the notation of Section |21 we have 

Ao = 0, e = A+, r = A = A+ U A_. 

The standard defining partition is V = ViT), and we have "Pgj^jgg = 'P(A). 
In view of the above, '^gj^^gg = and hence the two complexities coincide: 
F{n) = f{n). 

For a convex polygon, the notion of strongly singular billiard orbits and 
the notion of generalized diagonals coincide. The argument of Proposition El 
works. Due to the coincidences we just pointed out, it establishes a bijection 
between Vess('^) (resp. OE{n)) and the set of isolated (resp. families of) 
n-segment generalized diagonals in the convex polygon P. 

From this bijection and (j221); we obtain the first claim. Now the first 
statement of Lemma El yields the second claim. ■ 

Remark 1 The preceding proof yields expressions for the constants ci,C2. 
From (j^ . we have ci = 21^11 — \V2\,C2 = 17^2 1- Let the polygon P have p 
sides. The integer \Vi\ (resp. 1^21) is the number of types of 1-segment (resp. 
2-segment) billiard orbits in P. By convexity, \Vi\ =p{p—l). However, 1^2! 
is not determined by p alone. 

We will now apply the preceding material to the complexity of polygonal 
billiards. We will consider the three cases separately. 

3.3 The euclidean case 

There is a considerable literature on the billiard dynamics in euclidean poly- 
gons. See for references. Many basic questions remain open jSj. One 
of them is whether the complexity (of the coding by sides) of billiard orbits 
grows (at most) polynomially. It is known that the growth is subexponen- 
tial [131111101/° implying that the bilhard in a euclidean polygon has zero 
^°The discussion in 17] is restricted to simply connected polygons. 
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topological entropy. By Corollary |2l the complexity is bounded from above 
by the counting function for generalized diagonals. The latter also grows 
subexponentially ^U], and is believed to grow at most polynomially [H]. 

A euclidean polygon is rational if all of its angles are rational multiples 
of TT. Rational polygons play an important role in the subject [T31 116j . 

Theorem 3 Let P be a rational euclidean polygon, and let F{-) be the side 
complexity of billiard orbits in P. Then there exists c > such that 

F{n) < cn\ (34) 

If P is convex, then there exist positive constants Ci,C2 such that 

cin^ < F{n) < canl (35) 

Proof. By a theorem of H. Masur jTS|, GD{n) grows quadratically for 
rational polygons. More precisely, there exist positive constants c'l^c^ such 
that 

c\n^ < GD{n) < c^n^. (36) 

The first claim follows from this and the bound (j31|) . The second claim fol- 
lows the same way from the formula above and the identity (j33|) . ■ 



Remark 2 We believe that the cubic lower bound on complexity (jH^ is 
valid for arbitrary rational polygons. However, the geometry of the billiard 
map is much simpler in the convex case, as we saw in section 13.21 Figure El 
shows that the singular graph of the billiard map in a quadrilateral is much 
more complicated in the nonconvex case. The bounds were obtained in 

El 



3.4 The elliptic and the hyperbolic geometries 

The billiard in a spherical polygon has two salient features. First, the bil- 
liard map is a piecewise isometry. Second, a spherical polygon may have 
non-isolated strongly singular orbits, in particular, non-isolated generalised 
diagonals. 

We will use the notation Geo (M) for the space of oriented geodesies on 
M. Let (p : Geo (S*^) — > S"^ be the standard diffeomorphism. (See Section 
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Figure 6: Singular set for the billiard in a euclidean quadrilateral: i) convex; 
ii) nonconvex 



for a discussion of spherical duality.) Pulling back by (f) the round metric 
on 5"^, we obtain an invariant metric; the distance between two great circles 
is the angle between them. Metric geodesies and geodesies of the projective 
structure coincide. 

Let now P C S*^ be a polygon. Let X = X{P) be the billiard map phase 
space, and let : X — > Geo (S"^) be the map introduced in Section |21 Pulling 
back by (p induces not only the structure of a piecewise convex surface on X 
but also a metric on convex pieces of the phase space. Locally, the billiard 
map Th : X ^ X is a. geodesic reflection, i.e., an isometry. We summarize 
this discussion as a proposition. 

Proposition 8 Let P be an arbitrary spherical polygon. Then the billiard 
map phase space is a piecewise metrically convex Riemannian surface. The 
billiard map is a piecewise isometry. 

This observation has consequences for complexity of billiard orbits. 

Theorem 4 Let P be any spherical polygon.^^ Then the complexity of the 
coding of billiard orbits by sides of P grows subexponentially . 

^^We do not assume that P is an admissible polygon. 
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Proof. Let {X, T, V) be the associated piecewise convex transformation. 
Denote by /(■) its complexity, and let F{-) be the standard complexity of 
billiard orbits. By the proof of Corollary |21 F[n) < f{n). Hence, it suffices 
to show that f{n) grows subexponentially. By Proposition |H1 {X,T,V) is a 
piecewise isometry on a convex partition. By Theorem 4.2 of PU]; its com- 
plexity has subexponential growth. ■ 



The examples below illustrate peculiarities of spherical polygonal bil- 
liards. 

Example 1. Let P C S"^ be a polygon such that G{P) is a finite group. 
For instance, P may be the fundamental domain of a finite, generated by 
refiections group of isometrics. Then every billiard orbit in P is periodic. 
Moreover, there is a finite number of symbolic codes corresponding to prime 
periodic orbits, hence complexity is bounded. 

Example 2. Let P be a "bigon"; it is bounded by two geodesies, a,b con- 
necting the North and the South poles. Let a be the angle between them.^^ 
If a is TT-rational, then we are in the situation of Example 1. We will now 
discuss the case when a is 7r-irrational. 

First, we point out that in any case the set Sgjj^g(?7,) consists of 2 elements: 

a, b,a,b, . . . and b,a,b,a, . . . . Thus, F{n) = 2. 

There is an obvious periodic orbit. It corresponds to the intersection of 
P with the equator, and it has 2 segments, perpendicular to a, b. We will 
denote this orbit by 70. 

Claim. Let a be vr- irrational. Then 70 is the only prime periodic orbit in P. 

We will show that any periodic orbit 7 is a multiple of 70. We can assume 
that 7 has an even number, 2m, segments, and that its symbolic code is 

b, a, . . . ,b,a. Then the element, (7(7), of the group G{P) that we obtain by 
tracing 7 is (p)™ where p is the rotation about the vertical axis by the angle 
2a. 

Let £(7) be the spherical geodesic corresponding to 7. (Note that £(7) 
differs, in general, from the unfolding 7, which is a geodesic segment along 
£(7).) The periodicity of 7 implies that £(7) is invariant under (7(7), which 
rotates the sphere about the vertical axis by 2ma. The only geodesic in- 
variant under this (nontrivial!) rotation is the equator, which implies the 

^^These polygons are well known. See, e.g., 
^•^Note that P is not an admissible polygon. 
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claim. 

By convention, a periodic billiard orbit in P does not pass through its 
corners. In particular, it cannot trace the boundary of P. It is not known if 
every euclidean polygon has a periodic orbit P . Below we present a spherical 
polygon without periodic orbits. 

Example 3. For < a < 27r let Q = Q{a) be the isosceles spherical triangle 
with two right angles, and whose third angle is a. If a is vr-rational then every 
billiard orbit in Q is periodic. If a is 7r-irrational, then Q has no periodic 
billiard orbits. We outline a proof below. 

The triangle Q is obtained from the bigon P of Example 2 by folding it 
about the equator. In this situation, every billiard orbit, 7, in Q uniquely 
lifts to a billiard orbit 7 in P; the orbit 7 is periodic iff so is 7. If a is tt- 
rational, then Q satisfies the conditions of Example 1. Let a be vr-irrational, 
and let 7 be a periodic orbit in Q. By preceding remark and Example 2, 7 
runs along the equator. Thus, 7 traces the boundary of Q. 

We will now discuss the hyperbolic case. A positive function, s(-), of 
natural argument is subexponential if s{n) < e'^", s~^{n) < e^"' for any h > 
and all sufficiently great n. 

Theorem 5 Let P C be a geodesic polygon, and let f{-) be the complexity 
of the coding of billiard orbits by sides of P. Denote by htop the topological 
entropy of the billiard map in P. 

Then htop > 0; there exists a subexponential function s{-) such that f{n) = 

Proof. The billiard flow of P is (uniformly) hyperbolic [Hl-^^ Thus, the 
metric entropy of the billiard flow with respect to the Liouville measure is 
positive. By Abramov's formula, the metric entropy of the billiard map in P 
is positive, as well. The metric entropy is a lower bound on the topological 
entropy, hence our first claim. 

Let V, V^idQ be our defining partition and the partition by sides of the 
phase space of the billiard map. Let a{t),j3{t) be infinite billiard orbits 
that bounce of the same sides ofPas— cxo<t<cxD. Let a{t), (3{t) be their 
unfoldings. Then a{t),j3{t) are infinite geodesies in such that the distance 

^"'This is a very special case of a general result in It can be obtained directly via 
standard techniques. Although specialists seem to be aware of it, to our knowledge this is 
not in the literature. 
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between them is bounded for — oo < t < oo. Hence a(— oo) = oo) and 
a{oc) = /3(oo) implying a = p. Thus, a = P, and hence 'Pgjfjg is a generating 
partition. 

Since V -< "Pgicle' convex partition V is generating as welL By [TU], the 
complexity of {X, T, V) has the form t(n)e''*°p", where t{-) is a subexponential 
function. The relation V -< "^gj^jg implies f{n) < t{n)e^^°'p"'. The cardinality 
of the number of atoms of V{n) that partition an atom of 'P^[([q{i^) grows 
at most polynomially; thus f{n) > t{n)n~'^e^^°^"' for some positive integer d. ■ 

Remark 3 Unlike Geo{S'^), the spaces Geo (H^) and Geo (R^) do not have 
Riemannian metrics, invariant under the natural actions of the groups of 
isometries of and R^, respectively. However, there exists an invariant 
Lorentz metric on Geo(H^). We describe it below. 

Let H be the upper sheet of the hyperboloid 2;^ — — = 1 in R^ 
equipped with the pseudo- Riemannian metric g = dx^ + dy'^ — dz^. The in- 
duced metric on H is the metric of constant negative curvature. Isometries of 
H are the restrictions of (7-orthogonal transformations of the ambient space. 
Geodesies in H are its intersections with planes through the origin. 

Given such a plane, its (^-orthogonal complement is a line that intersects 
the hyperboloid of one sheet Hi = {z"^ — x"^ — y'^ = —1} at two antipodal 
points; if the plane is oriented then so is the line, and one can canonically 
choose one of these intersection points. This construction identifies Geo (H^) 
with Hi. The metric g induces a pseudo- Riemannian metric of signature 
(1, 1) on Hi. The identification above yields a Lorentz metric on Geo (H^). 

Let now P C be a geodesic polygon, and let X be the phase space 
of the billiard map in P. The canonical geodesic space structure in X is 
induced by the natural mapping p : X —>■ Geo (H^). Pulling back the Lorenz 
metric on Geo (H^), we obtain a metric h on X. By construction, h is locally 
invariant under the billiard map.^^ Thus, the billiard map in a hyperbolic 
polygon is a piecewise Lorentz isometry. We do not know of any applications 
of this observation. 

^^In general, /i is a Lorentz metric with singularities. If P is a convex polygon, then h 
is regular. 
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4 Complexity of polygonal outer billiards 



Let (X, T, V) be a piecewise convex transformation. If the mappings Tj : 
Pi ^ X are isometries, then (X, T, V) is a piecewise convex isometry. Piece- 
wise isometrics in one dimension are the interval exchange maps. They arise, 
in particular, from the billiard in rational polygons ^Hj, and have been much 
studied. We will investigate the complexity of a particular class of piecewise 
convex isometries - the outer billiard transformations. 

Let M be a simply connected surface of constant curvature x = 0, ±1. 
For X G M let Tj; : M — > M be the geodesic symmetry about x. Let P G M 
be a convex polygon with p vertices a,b,c, . . . listed counterclockwise. If 
X 7^ 1, set X = X(P) = M — P. If X = 1, i. e., M is the sphere, we assume 
that P is contained in a hemisphere. Let P' be the antipodal polygon, and 
set X = X(P) = M-P-P'. 
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P \ 







Figure 7: Definition of the outer billiard map 

For a vertex, say a, of P, let -Rq C X be the geodesic ray extending the 
side ab in the direction of a. The rays Ra, Rb, ■ ■ ■ partition X into convex 

^^This will be our standing assumption; wc will not restate it. 
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polygons Xa, -^6, .... See figure [7| We denote this partition by V. The 
statement below defines the protagonist of this section. 

Definition 3 Let M he a simply connected surface of constant curvature 
X, and let P d M he a convex polygon. Set X = M — Pifx^ 1? and 
X = M - P - P' zfx = I- 

Let V : X = Xa U X;, U ■ ■ ■ he the partition of X defined ahove. Then 
V is a convex geodesic partition. The piecewise convex isometry {X, T, V) 
defined hy the geodesic symmetries Ta : Xa ^ X ,Th : Xh ^ X , . . . is the 
outer billiard ahout P, and the geodesic surface X = X{P) (Z M (it is a 
topological annulus) is the phase space of the outer billiard. 

We will use the notation To : X ^ X for the outer billiard, suppressing 
the subscript if no confusion arises. By complexity of the outer hilliard we 
mean the complexity of (X, T, V) with respect to the partition V. Now 
we introduce notation and terminology that will be used throughout this 
section. If g{n), h{n) are two positive sequences then we write g -<h ii there 
is a constant C such that for all n sufficiently large g{n) < Ch{n). li g -< h 
and h ^ g, then we write g h; we will say that the sequences have the 
same growth or are in the same (growth) class. If g ~< n*^ then we say that g 
grows at most polynomially with degree d, or that g is bounded by n'^. 

If G is a group with a finite set S = {si, . . . , Sp} of generators, we denote 
by G^g^ C G the set of elements that can be represented by products of at 
most n elements of 5" and their inverses. The growth class of the sequence 
gsin) = \G^s^\ does not depend on the choice of S If gs{n) ~ n^, then 
we say that the group G grows polynomially, with degree d. 

Let G = G{P) C Iso{M) be the group generated by the geodesic refiec- 
tions in the vertices of the polygon P. We will relate the growth of G and 
the complexity of the outer billiard about P. We proceed to study separately 
the three cases at hand. 

4.1 The euclidean case 

We will obtain polynomial bounds on the complexity of outer billiard. 

Theorem 6 Let P he a convex euclidean p-gon, and let /(■) he the complexity 
of the outer hilliard ahout P. Then n -< f{n) -< nP^^ . 
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Proof. The edges of the graph r„ are parallel to the sides of P; each edge 
is a segment or a half-line. Assume, for simplicity of exposition, that P has 
no parallel sides. Then there are p directions. For each direction there are 
n parallel half-lines, hence their total number is pn. Since they partition X 
into pn components, the number of faces of r„ is at least pn. This yields the 
linear lower bound on complexity. Now, for the upper bound. 

Let G = G{P), and let S = {Ti, . . . , Tp} be its natural set of generators. 
We will need a few lemmas. 

Lemma 7 The growth of G is bounded by n^~^. 

Proof. The subgroup H C G generated by TiTp, T2Tp, . . . , Tp^iTp is a quo- 
tient group of Z^"^; hence its growth is bounded by n^"^. Since if is a normal 
subgroup of G of index 2, the two groups have the same growth. ■ 

Let r = dV, and let Fi, F2, ... be the canonical sequence of graphs; see 
Section HJ Let 7„ be the set of edges of F„ \ F„_i 

Lemma 8 The first difference of the sequence \'-fn\ is bounded by n^~^ . 

Proof. The edges of 7„_|_i are obtained from the edges of 7^ by applying the 
inverse map T~^. Each time a singularity half-line of T~^ intersects an edge 
of 7n, this edge splits into two, and thus contributes 1 to |7n+i| — |7n|- 

Let Ln be the set of straight lines obtained by reflecting at most n times in 
the vertices of P the extentions of the sides of P. By Lemma[71 -< n^~^. 
Each of these lines intersects a singularity half-line of T~^ at most once, 
therefore the total number of intersections of the lines in L„ with the singu- 
larity half-lines of T~^ is bounded above by n^~^. The edges of 7^ belong to 
the lines from L^, therefore the total number of intersections of these edges 
with the singularity half-lines of T~^ is bounded above by n^"^. (Note that 
the number of the edges of 7^ could be bigger.) ■ 

We wfll now obtain the desired bound on complexity, i.e., we will esti- 
mate the number of faces of F„. Denote by |-F„|, lE'nl, the number of 
faces, edges, vertices of the graph F„ respectively. By Lemma |Hl growth of 
the second diff'erence of the sequence \En\ is at most polynomial of degree 

^^We conjecture that there is a universal quadratic lower bound. 
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p — 1, hence \En,\ n^~^^. The edges of r„ are parallel to the sides of P, 
thus may have at most p possible directions. Therefore, each face of r„ is 
at most a 2p-gon, and the valence of each vertex of r„ is at most 2p. Thus, 
\En\ < p|Pn.|, \En\ < p\Vn\- Euler's formula \Vn\ — \En\ + \Fn\ = implies 
p\Fn\ < (p- l)|-E'n|, hence -< \En\. ■ 

We have obtained our bound, assuming that the rank of the abelian 
group generated by the sides of P is p — 1, i.e., maximal possible. Although 
generically this is the case, the rank may drop. Our argument proves, in fact, 
the statement below. 

Corollary 3 Let P be a convex euclidean p-gon, and let r < p — 1 be the 
rank of the abelian group generated by translations in the sides of P. Then 
the complexity of the outer billiard about P is bounded by n^^"^ . 

A polygon is rational if the rank above is 2. Rational polygons are dense 
in the space of all polygons. We will study complexity of the outer billiard 
about a rational polygon. First, we recall preliminaries. 



P 





We regard the plane as a vector space, with the center in the interior 
of the convex p-gon P. A well known construction [THj associates with P 
a homothetic family of centrally symmetric convex polygons with at most 
(resp. exactly) 2p sides (resp. if P is a generic p-gon). Let Q be a particular 
polygon in this family. Each of its sides is parallel to a diagonal of P. See 
figure IHl We endow the plane with a Minkowski norm such that Q is the unit 
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disc. The vector norm | ■ |, radius, etc, will be understood with respect to it. 
We set Q{r) = r ■ Q. 

The polygon Q determines the geometry of orbits of "at infinity" ^H] ■ 
We will elaborate. Let a; be a point in the plane which is sufficiently far from 
the origin. Let Qx be the circle centered at the origin and passing through x. 
Let a G Qxhe the side containing x, and let d be the corresponding diagonal 
of P (parallel to a). Then translates x along a by 2\d\; this continues 
until the orbit of x overshoots a. Let y = T^*" be the corresponding point. 
Then the recipe above is applied to y, etc. See figure IHl 




Figure 9: Second iteration of the outer billiard map "at infinity" 



Let a be an arbitrary side of Q, and let d be the corresponding diagonal of 
P. The polygon P is quasirational if, up to a common factor, the p numbers 
|a|/|(i| are rational. 

Theorem 7 Let P he a rational polygon, and let /(■) he the complexity of 
the outer hilliard ahout P. Then f{n) ~ . 

Proof. Every rational polygon is quasirational. By a construction of R. 
Kolodziej ^3], there is a nested sequence of T-invariant polygonal simply 
connected domains ■ ■ ■ C t/j C Ui+i C ■ ■ ■ exhausting the plane. By [T^ . 

-"^^This construction was used in to prove the boundedness of all outer billiard orbits 
about quasirational polygons. If this is the case for arbitrary p-gons remains an open 
question for p > 4 
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there exists a constant C = C{P) > such that the Kolodziej domains satisfy 
Q{Ci) C Ui C Q{C{i + 1)). We will need a general lemma. 

Lemma 9 Let P he an arbitrary convex polygon, and let /(■) he the com- 
plexity of the outer billiard about P. There exists Ci > such that the 
contribution to f{n) of the exterior of the disc of radius Ciu grows linearly. 

Proof. We will use the preceding notation and terminology. For any side a 
of Q set Ta = \a\/\d\. Let Ci > 2/ra for all sides of P. 

Consider the T^-orbit of length n of an arbitrary point x outside of 
Q{Cin). It follows a side, a, of Q foi k < n iterations, then it "jumps" 
to the adjacent side, a', and follows it for n — k iterations. Counting the 
possibilities (and assuming that Q is a 2p-gon, i.e., that we are in the generic 
sitiation) we obtain 2p{n + 1) types of T^-orbits of length n. But different 
types mean different contributions to /(2n), and vice versa. ■ 

Since P is a rational polygon, the group G C /so(R^) is discrete. The 
graphs r„ are obtained from a finite collection of half-lines by G-action, 
hence Too = U„>ir„ belongs to a discrete collection of lines. Therefore Foo 
is a graph, and the sequence Fi C ■ ■ ■ C F„ C . . . stabilizes on compacta. 
Moreover, there is a finite collection of convex polygons, such that every face 
of Foo is congruent to a polygon in this collection. Hence the areas of the 
faces of Foo are bounded away from zero and infinity. 

Note that the constant Ci in Lemma IHl can be chosen arbitrarily large. 
We choose it so that ^ = r G N. Then for all n sufficiently large 

QiCin) C U^n C Q{Cin + C). (37) 

By Lemma El up to a linear term, f{n) is the number of faces of F„ 
intersecting Q{Cin). By the left inclusion in (jSZI), this is less than or equal 
to the number of faces of Foo in Um- By preceding remarks, there is C2 > 
such that that number is bounded by C2area(?7T-„). By the right inclusion 
in (jSZj), axea.{Urn) is quadratic in n. We have obtained the upper bound 
/(n) ^ n^. 

Now for the lower bound. All regular points in X are periodic ^M. IT^ . 
A face F d X oi F^ is stable if F is a face of Foo. Let C X be the set of 
points with period at most n. Each connected component of Vn is an open, 
stable face of F„. By remarks above, the number of connected components 
of Vn has the same growth as the area of V„, thus area(V„) -< f{n). By 
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Proposition El below, area(14) ~ in?. 



The following proposition is used in the proof of Theorem It is also of 
independent interest. If h are positive functions on F C R^, the notation 
g -< h means that g{x)/h{x) is bounded as |x| — oo. The notation g ^ h 
means that g -< h, h ~< g. 

Proposition 9 Let P be a convex polygon and let Xpci G X be the set of 
periodic points of the outer billiard. For x G Xpcr let p{x) be the period. 

1. We have \x\ -<p{x). 

2. Let P be a rational polygon. Then for all regular points p{x) ~ Let 
Vn be the set of points such that p{x) < n. Then areaiVn) ~ n? . 

Proof. We assume without loss of generality that p{x) = 2m. Let be 
the circle through point x. The sequence x, T^(x),... roughly follows Q^- 
To come back to x, the sequence has to go around Qx at least once. Let S 
be the "largest step" of T^. Then we need at least perimeter(Qa;)/(5 steps to 
return. Since perimeter (Qa;) ~ |a;|, the first claim follows. 

Let now P be rational, and hence quasirational polygon, and let Uk, k > 
1, be the Kolodziej domains. Let k = k{x) be such that x G Uk \ Uk-i- The 
relations Q{Ck) C f/fc C Q{C{k + 1)) imply that the function k{x) satisfies 
k{x) ~ By inclusion Uk \ Uk-i C Q{C{k + 1)) \ Q{C{k - 1)), we have 
area(f//c \ Uk-i) ~ \x\. The point x belongs to a unique face, F = F{x), of 
Foo, hence p(x)area(F) < area(t/fc \ Uk~i). By preceding remarks, p{x) -< 
area(f/fe \ f/fc_i), implying p{x) -< \x\, and hence the equivalence p{x) ~ 

By this relation, there are constants C3, C4 > such that for n sufficiently 
large Q^C^n) C Ki C Qi^C^n), proving the last claim. ■ 



4.2 The elliptic and the hyperbolic cases 

We will first study the outer billiard in elliptic geometry. 

Theorem 8 Let P C S"^ be a convex spherical polygon. The complexity of 
outer billiards about P grows subexponentially. 

Proof. For a; G 5^ let / = x* be the appropriately oriented great circle 
centered at x. This diffeomorphism S"^ Geo{S'^) is the spherical duality, 
and we denote by x = /* the inverse diffeomorphism. 
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Let A,B, . . . be the vertices of P. The geodesies a = A*,b = B*, . . . 
bound the convex polygon P*. The correspondence P i— ^ P* is an automor- 
phism of the space of convex spherical polygons. The proof of the following 
lemma is contained in ^7j. (See also |16j.) 

Lemma 10 Let P, P* C be as above. Let Xg, Xi, be the phase spaces of 
the outer billiard about P , inner billiard about P* , and let To : Xo — >■ Xq, Tb : 
Xh Xh be the outer billiard, inner billiard maps respectively. 

The spherical duality induces a diffeomorphism Xo — > Xb; it conjugates 
To : Xo — > Xo and Tb : X^ ^ Xb; it induces an isomorphism of the coding of 
To-orbits by corners of P and the coding of Tb-orbits by sides of P* . 

Figure ITUl illustrates Lemma ITUl Let foin) (resp. fb{n)) be the corner 
complexity of the outer billiard about P (resp. billiard in P*). By Lemma ITUl 
fo{n) = fb{n + 1). The claim now follows from Theorem |^ ■ 




Figure 10: Duality between inner and outer billiards 



We refer to [B] for the background on polygonal outer billiards in the 
hyperbolic plane. Let P C be ap-gon, let X = H^\P, and letT : X ^ X 
be the outer billiard map. It extends to a homeomorphism of the circle at 
infinity, t : S ^ S. Its rotation number satisfies p(P) > 1/p jH]- The polygon 
P is large if p(P) = l/p and r has a hyperbolic p-periodic orbit. See figure 
im The set of large polygons is open in the natural topology jO] . 

Theorem 9 Let P C be an arbitrary convex polygon, and let f{-) be the 
complexity of the outer billiard about P. Then n -< f{n). If P is a large 
polygon, then f{n) ~ n. 
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Figure 11: A large quadrilateral 



Proof. The bound n -< f{n) fails iff the sequence T^, k > 1, stabilizes. 
Assume this to be the case, and let = F^+i = ■ ■ ■ = Foo- The outer 
billiard map T : X ^ X preserves Fqo; the restriction of T to a closed face 
of Foo is a diffeomorphism onto another one. Since Foo is a finite graph, we 
find 72 G N such that every face of Foo is invariant under T". 

Let F be a closed face of Foo- Then dFCiS is either empty, or a vertex, or 
an edge of F. We will study the latter. Let vi, . . . ,vn G 5" be the consecutive 
endpoints of these edges, let Ci C S (resp. C H^) be the circular arc (resp. 
the geodesic) with endpoints (we set + 1 = 1), and let Fi be the 

corresponding face of Foo- The restriction T"'\f^ is induced by an isometry, 
gi G /so(H^). The elements gi, . . . ,gj^ are all equal to the identity iff = 1. 

Lemma 11 The map t : S ^ S is not periodic. 

Proof. Let 2; be a vertex of P. For close points xi,yi G S let X2,y2 £ S 
be their reflections about z. Let Ai = |a;22;|/|xi^| and let 2ai be the angular 
measure of the arc Xii/i, i = 1,2; see flgure[T21 The triangles Xizyi and X2zy2 
are similar, therefore 

sin 02 = Ai sin «!. (38) 

Let xi, . . . , xat be a periodic trajectory of the map r consisting of smooth 
points, and let Ai...,AAr be the respective ratios. Set A = UfLiXi. Let 
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Xl 




Figure 12: Computing the distortion of the map r 



Hi be a point sufficiently close to Xi, and let yi,. . . ,yN be its r-orbit; we 
assume that for both orbits the reflections occur in the same vertices of P. 
It follows from equation IHHl that yi, ... ,yisf is a. periodic trajectory iff A = 1. 
In particular, if r has a periodic interval, then A = 1 there. 

Let now xi cross counter-clockwise a singularity half-line of T. In the 
notation of figure IT51 Ai = {b + c)/a (resp. Ai = c/{a + b)) right before (resp. 
after) this. By {b + c) / a > c/ {a + b) , the equality A = 1 before a singularity 
half-line implies that A < 1 immediately after it. ■ 

By Lemma ^3 "we can assume without loss of generality that gi ^ 1. 
Then gi is a (hyperbolic) parallel translation with the axis cti, and Fi is 
the domain bounded by ai and Ci. We will say that Fi is a lunar face of 
Foo- The union of lunar faces of Foo is invariant under T. Therefore for any 
A; > there is I = l{k) such that T~^{ai) = ai. A geodesic cti, 1 < i < N, 
cannot contain a side of P. If it does, then Fi contains a singular line of 
T in its interior, contrary to the definition of Fj. See figure IT^ where X1X2 
represents now the geodesic ai. Thus, ai is not an edge of F^ for any m. 
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Figure 13: Destruction of a periodic orbit of r 



This contradiction proves our first claim. 

Let now P be a large p-gon. Then r„ is a disjoint union of p binary trees 
|Sj (see figure HH), and hence |r„| grows linearly. ■ 

Remark 4 Note that the function /(■) is bounded below by the complexity 
of the induced map r : S ^ S with respect to the natural partition. However, 
the latter may be finite. See figure ITSl 
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